1 link tagged with all of: jev + decisions api + llm + luna
Click any tag below to further narrow down your results
Links
OpenAI has made its Decisions API generally available, a fast, cheap model for picking among options with a confidence score, meant to compete with TypeSafe's Jev. The pitch is that for many workflows, a quick classifier-style model can replace a full LLM.
- OpenAI didn't build a dedicated decision model; it repurposed its ChatGPT Luna model and tuned it for lower latency and cost.
- Speed is the main selling point: response times dropped from 1-3 seconds to roughly 100-180 milliseconds, and Speak cut its action gap from 1.4 seconds to 0.13 seconds.
- Benchmarks don't settle which decision model is best. Jev ranks well on some indices and tops the PacMan-based JevMan test, while OpenAI's model ranks lower, though it may have an edge in image classification.